Learning Coordinated Behaviors for Control of a Simulated Race Car

نویسندگان

  • Larry D. Pyeatt
  • Adele E. Howe
  • Charles W. Anderson
چکیده

category: Control, navigation and planning This work is not in submission or press to any other conference. Abstract The demands of rapid response and the complexity of many environments make it diicult to decompose, tune and coordinate re-active behaviors while ensuring consistency. We hypothesize that complex behaviors should be decomposed into separate behaviors resident in separate networks, coordinated through a higher level controller. To explore these issues, we have implemented a neu-ral network architecture as the reactive component of a two layer control system for a simulated race car. By varying the architecture , we tested whether decomposing reactivity into separate behaviors leads to superior overall performance and learning convergence. Based on these results, we further modiied the architecture to produce a race car that is competitive with publicly available solutions.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Reinforcement Learning for Coordinated Reactive Control

The demands of rapid response and the complexity of many environments make it diicult to decompose, tune and coordinate reactive behaviors while ensuring consistency. Reinforcement learning networks can address the tuning problem, but do not address the problem of decomposition and coordination. We hypothesize that interacting reactions can often be decomposed into separate control tasks reside...

متن کامل

Learning to Race: Experiments with a Simulated Race Car

Experiments with a Simulated Race Car Larry D. Pyeatt Adele E. Howe Colorado State University Fort Collins, CO 80523 email: fpyeatt,[email protected] URL: http://www.cs.colostate.edu/~fpyeatt,howeg Abstract We have implemented a reinforcement learning architecture as the reactive component of a two layer control system for a simulated race car. We have found that separating the layers has ...

متن کامل

Coordinating Reactive Behaviors

Combinating reactivity with planning has been proposed as a means of compensating for potentially slow response times of planners while still making progress toward long term goals. The demands of rapid response and the complexity of many environments make it diicult to decompose, tune and coordinate reactive behaviors while ensuring consistency. Neural networks can address the tuning problem, ...

متن کامل

Behavior Based Control and Fuzzy Q-learning for Autonomous Mobile Robot Navigation

This paper presents collaboration of behavior based control and fuzzy Q-learning for mobile robot navigation systems. There are many fuzzy Qlearning algorithms that have been proposed to yield individual behavior like obstacle avoidance, find target and so on. However, for complicated tasks, it is needed to combine all behaviors in one control schema using behavior based control. Based this fac...

متن کامل

MoNiF: a modular neuro-fuzzy controller for race car navigation

This paper characterizes how well the modular neuro-fuzzy controller, MoNiF, can perform in robotic applications by testing it in a race-car simulator. The performance of this controller is compared with that of a neural network controller (NNC) and the best programmed car (the ideal car). During the phase of learning from the ideal car, MoNiF reaches its stable performance (when it demonstrate...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1996